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ABSTRACT 

Public uses of tests and testing include all those 
materials and practices in observation of huaan behavior that are 
intended to help adainistrators, school boards, legislatures, 
taxpayers, and others to evaluate their educational systeas. 
Pedagogical uses of tests, on the other hand, cover all those 
materials and practices in observation of huaan behavior that are 
intended to help the teacher do a better job of teaching or the 
learner do a better job of learning, or both. The aovement toward 
accountability affects public testing since if what legislators want 
students to deaonstrate is reading and writing skill, then that is 
what the tests for public use will measure. Economic considerations 
dictate that tests of reading and writing skills be usee! tc ascertain 
the general effectiveness of the whole organization of public 
education rather than that of single schools or individual teachers. 
Most important in the use of pedagogical tests is that they cover all 
the kinds of learning teachers hope to have the students attain. To 
accomplish this end, teachers can choose aaong standardized tests, 
teacher-Bade tests, and systematic observation of pupils. A good 
teacher who is also inforaed about measurement blends teaching and 
testing and learning so smoothly that it is often impossible to tell 
where one stops and another starts. (HOD) 
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LCN The first typed draft of this speech bore the title TESTING AND 

*-0 TESTS: PEDOLOGICAL VERSUS PUBLIC USES. I put that down to the very 



messy copy Ms. Prindle had to work from, but, as I read on, I realized 
that pedological appeared consistently. By the time I got to the last 
page I couldn't remember what the word was supposed to be. So I 
consulted a dictionary and realized for the first time (1) that there 
is a word pedology , (2) that it refers to two rather different sciences, 
and (3) that I have been engaged in the practice of one of those for many 
years. Furthermore, I use tests in studies of the development of children. 
Thus we meet on more common ground than I had suspected we might, for we 
come from disciplines that share not only a combining form but also a 
concern for measurement. 

The exercise was interesting too in its analogy to the pedagogical 
uses that a test can have. Just as Ms. Prindle f s typescript sent me on 
a dictionary exploration, so a good test can provoke learning experiences 
by students. That is a major message I want to leave with you today, 
although the NCTE program committee has asked me specifically to contrast 
pedagogical and public uses of tests. My job will be easier if I start 
by trying to define the two classes of test use: 

1, Pedagogical uses of tests and testing cover all those materials 
v) and practices in observation of human behavior that are intended to help 

^ the teacher do a better job of teaching or the learner do a better job of 

N 



learning, or both. 
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2. Public uses of tests and testing include all those materials 
and practices in observation of human behavior that are intended to 
help administrators, school boards, legislatures, taxpayers, and other 
interested groups outside the classroom in evaluation of their educational 
systems. 

One more definition before we get underway. Too many people, 
teachers and parents alike, act as if they think a "test" is tome tool 
of the devil that leads students to betray their ignorance, reveal the 
secret contents of their minds, uncover their psyches. It is, of course, 
nothing of the sort. Every test ever devised for school use is nothing 
more than a job on which, if he is so inclined, the student can demonstrate 
his skill, knowledge, or recollection. Asking a student to take a test 
is exactly the same thing as his mother saying to him, "Show Uncle Albert 
how you can play the violin." If the kid knows how to play the violin 
pretty well and is in good health and feels like showing off for Uncle 
Albert, you can't tell him from Heifetz. But if he hates to play the violin 
and doesn't play it well, has a stomach ache, and doesn't like Uncle Albert, 
you can tell him from Heifetz. 

Public Uses of Tests and Testing 
Remembering that, in spite of the technical jargon that surrounds 
them, tests are no more than jobs, worksaraples, let us consider first the 
public uses of tests. In the earliest days of public schooling, schools 
were small, very much a part of their communities, the teachers boarded 
around with various parents or board members, and what went on in the 
local school was quite naturally a matter of public knowledge. It was not 
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unusual to have a visitors' day once a month when students could demonstrate 
their knowledge md skills for all to see. When school districts and 
school buildings became larger, some of the intimate knowledge of 
students' classroom progress disappeared. Finally, in most places, the 
school district became so large and the state and national governments 
so deeply involved in education, that parents and other interested 
citizens found much to discourage them from finding out directly what 
kind of job the schools were doing. Oh, they were invited to show up 
at PTA meatings and at the annual open house, but they were enjoined 
—not always subtly— to "leave education to the professionals." 

Now the pendulum is on its return swin S . In one legislature after 
another, representatives of the people are saying to professional 
educators: "Show us. Prove to us that we are getting quality education 
of our young people in return for the huge investments of public funds we 
keep pouring into the schools." The popular term for this movement is 
"accountability," and, for reasons not entirely clear to me, it has 
produced a frantic reaction among many educators that is very much like 
the behavior of a colony of ants suddenly exposed to sunlight. 

Fortunately, the wild running about and hiding phase seems to be 
subsiding now in some placea-for example, in Florida and California-and 
it is possible to see dimly the outlines of what school accountability 
might be like. Let me describe it briefly, for this is where the public 
uses of tests and testing comes in. 
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In the first place, the public (as represented by legislatures) 
has a somewhat different view of "quality education" from that of 
most educators. Using information obtained in the ETS survey of 
education committees in state legislatures, we discover that parents 
and taxpayers limit their expectations primarily to the "Three Rs." 
"Give us high school graduates who can read the sorts of material that 
citizens must read, write legibly and with enough organization to gat 
over a short declarative message, and perform routine computations." 
When some of the interviewers asked these chairmen of legislative 
committees about such things as listening comprehension skills, speaking 
facility, knowledge of the structure of language— they figuratively 
shrugged their shoulders. "All oX that is very well," they said, 
"provide d students learn to read and write . " 

The implication is clear. If what legislators want students to 
demonstrate is reading and writing skill, 'then that is what the tests 
"for public use" will measure. And, of course, teaching students to 
read and write has been one of the major businesses of professional 
teachers of English for decades. 

Now, how will su ch tests of reading and writing be used? In ways 
that will show individual schools in a bad light? In ways that will 
endanger the jobs of teachers who have slow or otherwise handicapped 
classes? Possibly. There may be some legislators or taxpayer groups 
or even administrators who would like to evaluate single schools and 
individual teachers on the basis of student performance on statewide or 
regional tests mandated for accountability purposes, but one hard 
economic fact may deter them: th ey can't afford it . Think for a 
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minute of the material cost, teacher time, and scoring and analysis 
expense that would be involved in testing every student in every subject 
in every school every year! This is what those who would like to get 
a toe-hold on assessment of teachers by the test performance of their 
students would have to do. Even in states with high investments in 
education and great interest among legislators, it just about ruins the 
budget to test a sample of kids in three subjects in three grades out of 
twelve every year. 

So, in spite of the demonic glee that is generated in some quarters 
over the notion of statewide testing to "measure the quality of our 
schools and the effectiveness of our teachers simple economics dictate 
against such uses. Tests of reading and writing skills can be used in 
state and systemwide assessment efforts to ascertain the general 
effectiveness of the whole organization of public education, and 1 think 
that few of us would question this as an appropriate use. But they can 
seldom be used to "judge" single schools and almost never used to evaluate 
individual teachers. 

What should English teachers be expected to do about such public 
uses of tests? Probably pretty much what you are doing now, but perhaps 
with a new awareness of the priorities which others place on reading and 
writing skills in the language arts curriculum. If I were to teach 
English again—and I did once before I was lured into the less demanding 
field of psychology or pedology—I would be more inclined to relegate 
the productive skills to second place in the early grades until children 
seemed to have a firm command of the receptive skills of reading and writing. 
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And* at later grades, I would be more willing to abandon the prescribed 

syllabus in literature with those students who could hardly be expected 

to read it with understanding, what's more answer essay questions about 

it, and put my emphasis on those basic skills* 

Thus, even though individual teachers cannot be required to take 

personal responsibility for a statement derived from a public use of 

tests uch as "Thirty percent of the seniors graduating from high schools 

♦ 

in City X cannot read or write well enough. to function as participating 
citizens in our society," teachers who work conscientiously and collectively 
to improve reading and writing skills — not because they 1 re forced to but 
because they recognize their salience — can take pride in a statement 
that may appear a few years later to the effect that "Less than twenty 
percent of the seniors graduating from our high schools are deficient in 
reading and writing skills." 

Some of you may feel that I am putting too much sugar coating on the 
public uses of testing pill, and I certainly don't deny that tests and 
test results are sometimes misused and misinterpreted for strictly 
political purposes. However, an adversary relationship between teachers 
and politicians certainly will not reduce misuses and abuses. And an 
understanding relationship might at least stand a chance of doii4g that* 

Pedagogical Uses of Tests and Testing 
Now let f s turn to the uses of tests and testing to help the teacher 
teach better and the student learn better* If we can keep thinking of 
tests as job performances or skill demonstrations, instead of as sneaky 
peeks into the skulls of students, the process is fairly straightforward. 
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When students come to us, we inquire into the skills and knowledge 
they already possess (like the football coach having members of a 
green squad run through their paces for him). For this reason, we give 
them tests at the opening of a semester in order that we may teach them 
some things they don't already know. This is called placement testing— 
if the job covers many suhskills it is sometimes called diagnostic 
testing— and helps the teacher guess bet where to start the 
instruction of each student. To start a semester or any large unit 
of instruction without this kind of bench mark measure is sheer folly — 
like timing a hundred yard dash without knowing when each runner started. 

The tests or worksamples that follow the placement testing 
usually cover small amounts of instruction, so that both the teacher 
and the student can know without a long wait whether the instruction 
is "taking" or sliding off without visible effect. Most of these tests 
will be teacher-made instruments — teacher-made and teacher-scored. 
Occasionally, we hope, the tests themselves will be learning experiences— 
or stimulate them, just as a provocative statement in a magazine or a 
typist's "error" can lead adults to new insights or to seek new 
information. 

Because schools and teachers are the way they are, a great deal of 
the teaching that goes on represents an effort to get pupils to "know" 
thiags. That is, most of the effort is to get the student to remember 
factual information that ranges from the ridiculously simple to the 

* 

preposterously complex. There is "content" to be covered in the course. 
"Remember this because it will appear in the semester exams." No one 
doubts that a large proportion of pupil learning in school should consist 
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of remembered information, but teachers too often trap themselves into 
testing only factual recall even though their goals of instruction are 
far wider and richer. Being human beings, students almost without 
exception learn what they know they* 11 be tested on, and let the rest 
go by the board. So the teacher who aims instruction toward development 
of all kinds of insights and appreciations and tastes and critical 
processes will be bitterly disappointed if he or she routinely limits 
classroom testing to measures of recall — because the outcomes of that 
ambitious instruction will be a respectable amount of factual recall 
among those students who are interested or fearful, no recall among 
students who don't care, and no provable improvement of anybody in those 
other goal behaviors: insights and appreciations and tastes and critical 
processes. So let the test jobs you use to track the progress of 
students along the path of learning somehow cover all the kinds of 
learning you hope to have them attain. Let me give you an example, 
drawn from some work done by the English staff in a large high school, 
all of whom were committed to teaching Macbeth sometime during the 
senior year. (See Appendix A.) 

For a four-week unit on Macbeth , five teachers who were going to 
hit the play sometime during the semester got together and wrote down 
their general goals. These goals ultimately were eight in number: 
(1) to understand Macbeth in each of several ways, (2) to enjoy Macbeth 
in each of several ways, (3) to have an increased interest in reading plays 
and seeing more drama, (4) to develop better taste and preference as 



» 



consumers of drama, (5) to know and remember four btsic literary 
aspects of Elizabethan drama found in Macbeth . (6) to have some skill 
in analyzing the dramatic elements of a play, (7) to recognize, 
interpret, and retain some human values as expressed in Macbeth , and 
(8) to appreciate the reasons for Shakespeare's popularity in his time 
and ours. Now, that is a very sophisticated list of outcomes to 
seek with a high school class, but these teachers were wise enough 
not to expect total achievement of all outcomes by all students; they 
agreed to place proportionately high weights on Goals 1, 5, and 6— all 
being goals of knowing and remembering factual information — and low but 
nevertheless present weights on the other goals that had to do with 
interest and taste and appreciation. 

Then these teachers did an interesting thing. For each goal and 
subgoal in the unit, they wrote down what they called "Symptoms of 
Learning" (members of my profession have their own term for this, not 
nearly so clear, which is "behavioral objectives 11 ). These "symptoms 11 
were simply the kinds of things that students might do that could be 
taken as evidence that they had information or appreciation or interest 
or taste* To quote a few of the listed symptoms that teachers would 
accept as evidence that a student was learning to enjoy Macbeth : shows 
some evidence of emotional reaction to hearing ov reading the play, 
quotes favorite passages voluntarily, seeks and enjoys a part in a 
dramatization, volunteers opinions, debates points of interpretation, 
disagrees with the teacher or class, shows special sympathy for a 
particular character, mimics or burlesques some character — and so on. 



Then the last thing these teachers did in preparing their 
evaluation scheme for the students reading Macbeth was to make an 
"Assessment of Learning" column in which, for each of the symptoms 
of learning they had listed, they wrote down one or more ways in 
which they would observe and record the symptom if it occurred — an 
observational record for each student. The symptoms of learning that 
had to do with knowing, understanding, remembering, interpreting, 
and analyzing, as you might expect, were mostly set up for observation 
by "tests," multiple choice, short-answer questions, essay questions, 
and so forth. To observe the symptoms of .things such as enjoying and 
having better taste and appreciating, however, those teachers had to be 
a little more creative. They relied heavily on performance check lists 
in which they made an entry each time some student exhibited one or 
another of the kinds of behavior that the teachers had listed under 
"symptoms of learning." In order to avoid spending all their tiae 
making notes on check lists, these teachers very soon learned to note 
only the first few instances of a symptomatic behavior — or only those 
instances that pointed toward some kind of change in the student. 

I'd be derelict if I neglected to mention that there are literally 
hundreds of published tests available to you for pedagogical uses in 
English. Among them are many tests of great value in observing student 
growth in reading skills. However, because of the difficulties in 
specifying scoring procedures and standards, standardized tests of 

) 
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wilting ability are scarce. There are, of course, many test tasks that 
require the examinee to edit or rewrite or find the errors in sooebody 



else's writing. However, these are not tests of writing ability at all— 
they are tests of editing, which is something else. So even if it 
means that you have to read stacks of student papers nearly every night, 
if you want to find out how each kid writes in order to be able to help 
him write better you have little choice but to ask him to write for you. 
You'll do a better job of this if you ask for short papers, let the 
student decide what he wants to write about, tell him the criteria you 
are going to use in reviewing and commenting on his paper— then review 
gBly. on the basis of those previously-announced criteria. 

As to measurement of the knowledge and cognitive skills students 
acquire in the study of literature— the major goals in my illustration 
of the teaching of Macbeth , for example — I can recommend the 
Cooperative Literature Tests , which offer matched pairs of tests on 
each of more than twenty major works of fiction often included in high 
school English Instruction. These tests, build by scholars and teachers 
of literature, probe the works in considerable depth. It is suggested 
that students take the first test on their own while they are studying 
the work. The questions are designed not only to enable students to 
find out if they are "following" the work fairly well, but also to remind 
them of points they might have overlooked and of alternate interpretations 
of characters and events. The second test can be used later as the 
"final" or part of the "final" on the work. 

So I have mentioned some ways in which teachers of English can use 
standardized tests, teacher-made tests, and systematic observation of 
pupils in understanding their students' learning needs and watching them 
change as learning progresses. Informed and sensible use of a variety 
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of measurement techniques by the teacher does not indicate an over- 
dependence on testing; rather, it reveals a teacher who knows what 
she or he wants to do in teaching young human beings and how to tell 
whether that teaching is working, ia the work of a good teacher who is 
also informed about measurement, teaching and testing and learning can 
blend into each other so smoothly that is is often not possible to tell 
where one stops and another starts. 
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